User terminal apparatus and control method thereof

ABSTRACT

A user terminal apparatus and a control method thereof are provided. The user terminal apparatus includes a display including a main display area which is disposed on a front surface of the user terminal apparatus, and a sub display area which extends from one side of the main display area and is disposed on at least one area of a rear surface of the user terminal apparatus, a camera configured to photograph an image, and a processor configured to display a live view acquired through the camera on one of the main display area or the sub display area, and control the display to display, in response to an orientation of the user terminal apparatus being changed, the live view on another one of the main display area or the sub display area.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application is a continuation application of prior application Ser.No. 16/834,848, filed on Mar. 30, 2020; which is a continuationapplication of prior application Ser. No. 15/915,696, filed on Mar. 8,2018, which issued as U.S. Pat. No. 10,645,292 on May 5, 2020; which isa continuation application of prior application Ser. No. 15/176,630,filed on Jun. 8, 2016, which has issued as U.S. Pat. No. 9,936,138 onApr. 3, 2018; and which was based on and claimed priority under 35U.S.C. § 119(e) of a U.S. Provisional application Ser. No. 62/198,360,filed on Jul. 29, 2015, in the U.S. Patent and Trademark Office, andunder 35 U.S.C. § 119(a) of a Korean patent application number10-2016-0001684, filed on Jan. 6, 2016, in the Korean IntellectualProperty Office, the disclosure of each of which is incorporated byreference herein in its entirety.

TECHNICAL FIELD

The present disclosure relates to a user terminal apparatus and acontrol method thereof. More particularly, the present disclosurerelates to a user terminal apparatus which uses displays disposed on thefront surface and the rear surface of the user terminal apparatus whenphotographing, and a control method thereof.

BACKGROUND

Due to the development of electronic technology, various kinds ofelectronic devices are being used in various fields. In particular, anelectronic device which has a display expanded to the rear surfacethereof through out-bending (half round display) is being developed.

It is common that a camera is provided on the rear surface of theelectronic device. As a display is provided on the rear surface of theelectronic device, selfie photographing may be easily performed. Inaddition, even when the electronic device is provided with a singlecamera, a user may photograph while checking a photography state usingthe rear display.

Accordingly, there is a demand for a method of ensuring availability ofa rear display when a photographing function is used.

The above information is presented as background information only toassist with an understanding of the present disclosure. No determinationhas been made, and no assertion is made, as to whether any of the abovemight be applicable as prior art with regard to the present disclosure.

SUMMARY

Aspects of the present disclosure are to address at least theabove-mentioned problems and/or disadvantages and to provide at leastthe advantages described below. Accordingly, an aspect of the presentdisclosure is to provide a user terminal apparatus which controlsdisplays disposed on the front surface and the rear surface of the userterminal apparatus based on a photographing situation, and a controlmethod thereof.

In accordance with an aspect of the present disclosure, a user terminalapparatus is provided. The user terminal apparatus includes a displayincluding a main display area which is disposed on a front surface ofthe user terminal apparatus, and a sub display area which extends fromone side of the main display area and is disposed on at least one areaof a rear surface of the user terminal apparatus, a camera configured tophotograph an image, and a processor configured to display a live viewacquired through the camera on one of the main display area or the subdisplay area, and control the display to display, in response to anorientation of the user terminal apparatus being changed, co the liveview on another one of the main display area or the sub display area.

In accordance with another aspect of the present disclosure, a controlmethod of a user terminal apparatus is provided. The control methodincludes a display including a main display area which is disposed on afront surface of the user terminal apparatus, and a sub display areawhich extends from one side of the main display area and is disposed onat least one area of a rear surface of the user terminal apparatus, anda camera configured to photograph an image which includes displaying alive view acquired through the camera on one of the main display area orthe sub display area and displaying, in response to an orientation ofthe user terminal apparatus being changed, the live view on another oneof the main display area or the sub display area.

Other aspects, advantages, and salient features of the disclosure willbecome apparent to those skilled in the art from the following detaileddescription, which, taken in conjunction with the annexed drawings,discloses various embodiments of the present disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features, and advantages of certainembodiments of the present disclosure will be more apparent from thefollowing description taken in conjunction with the accompanyingdrawings, in which:

FIGS. 1A and 1B are views to illustrate an example of a configuration ofa display of a user terminal apparatus according to various embodimentsof the present disclosure;

FIG. 2A is a block diagram illustrating a configuration of a userterminal apparatus according to an embodiment of the present disclosure;

FIG. 2B is a block diagram illustrating an example of a detailedconfiguration of a user terminal apparatus according to an embodiment ofthe present disclosure;

FIG. 2C illustrates various modules stored in a storage according to anembodiment of the present disclosure;

FIG. 3 illustrates an example of using one of a main display area, a subdisplay area, and a round display area according to an embodiment of thepresent disclosure;

FIG. 4 illustrates an example of using at least two of a main displayarea, a sub display area, and a round display area according to anembodiment of the present disclosure;

FIG. 5 illustrates respective areas and an example of an operationcorresponding to a touch input according to an embodiment of the presentdisclosure;

FIG. 6 illustrates an operation in response to the orientation of theuser terminal apparatus being changed according to an embodiment of thepresent disclosure;

FIGS. 7A and 7B illustrate an example of a method for changing aprovided image according to a display area according to variousembodiments of the present disclosure;

FIGS. 8A and 8B illustrate an example of a method for executing aspecific function through a main display area according to variousembodiments of the present disclosure;

FIG. 9 illustrates a method for displaying a live view on both a maindisplay area and a sub display area according to an embodiment of thepresent disclosure;

FIG. 10 illustrates a method for displaying a live view on a maindisplay area and displaying a specific content on a sub display areaaccording to an embodiment of the present disclosure;

FIGS. 11A and 11B illustrate an example of a method for determining anarea to display a live view according to various embodiments of thepresent disclosure;

FIG. 12 illustrates a method for detecting a change in an orientation ofa user terminal apparatus according to an embodiment of the presentdisclosure;

FIGS. 13A and 13B illustrate an example of an operation corresponding toa change in an orientation of a user terminal apparatus according tovarious embodiments of the present disclosure;

FIGS. 14A and 14B illustrate an example of a method for executing aphotographing function according to various embodiments of the presentdisclosure;

FIG. 15 illustrates a method for using the round display area accordingto an embodiment of the present disclosure;

FIG. 16 illustrates a camera which is provided on a front surface of auser terminal apparatus according to an embodiment of the presentdisclosure;

FIGS. 17A to 17C illustrate an example of a case in which otherapplications are used according to various embodiments of the presentdisclosure;

FIGS. 18A and 18B illustrate an example of a configuration of a displayaccording to various embodiments of the present disclosure; and

FIG. 19 is a flowchart to illustrate a control method of a user terminalapparatus according to an embodiment of the present disclosure.

Throughout the drawings, like reference numerals will be understood torefer to like parts, components, and structures.

DETAILED DESCRIPTION

The following description with reference to the accompanying drawings isprovided to assist in a comprehensive understanding of variousembodiments of the present disclosure as defined by the claims and theirequivalents. It includes various specific details to assist in thatunderstanding but these are to be regarded as merely exemplary.Accordingly, those of ordinary skill in the art will recognize thatvarious changes and modifications of the various embodiments describedherein can be made without departing from the scope and spirit of thepresent disclosure. In addition, descriptions of well-known functionsand constructions may be omitted for clarity and conciseness.

The terms and words used in the following description and claims are notlimited to the bibliographical meanings, but, are merely used by theinventor to enable a clear and consistent understanding of the presentdisclosure. Accordingly, it should be apparent to those skilled in theart that the following description of various embodiments of the presentdisclosure is provided for illustration purpose only and not for thepurpose of limiting the present disclosure as defined by the appendedclaims and their equivalents.

It is to be understood that the singular forms “a,” “an,” and “the”include plural referents unless the context clearly dictates otherwise.Thus, for example, reference to “a component surface” includes referenceto one or more of such surfaces.

The terms such as “first” and “second” used in various embodiments areused to distinguish various elements from one another regardless of anorder or importance of the corresponding elements. Accordingly, theorder or importance of the elements is not limited by these terms. Forexample, a first element may be named a second element without departingfrom the scope of right of various embodiments of the present invention,and similarly, a second element may be named a first element.

It will be understood that, when an element (e.g., a first element) is“(operatively or communicatively) coupled with/to” or “connected to”another element (e.g., a second element), the element may be directlycoupled with/to another element, and there may be an intervening element(e.g., a third element) between the element and the other element. Tothe contrary, it will be understood that, when an element (e.g., a firstelement) is “directly coupled with/to” or “directly connected to”another element (e.g., a second element), there is no interveningelement (e.g., a third element) between the element and the otherelement.

All of the terms used herein including technical or scientific termshave the same meanings as those generally understood by an ordinaryskilled person in the related art unless they are defined otherwise. Theterms defined in a generally used dictionary should be interpreted ashaving the same meanings as the contextual meanings of the relevanttechnology and should not be interpreted as having ideal or exaggeratedmeanings unless they are clearly defined in the various embodiments.According to circumstances, even the terms defined in the embodimentsshould not be interpreted as excluding the embodiments of the presentdisclosure.

Various embodiments will be explained in detail with reference to theaccompanying drawings.

FIGS. 1A and 1B are views to illustrate an example of a configuration ofa display of a user terminal apparatus according to various embodimentsof the present disclosure.

Referring to FIG. 1A, the left view shows the front surface of a userterminal apparatus 100, and the right view shows the rear surface of theuser terminal apparatus 100. A front display is disposed on the frontsurface of the user terminal apparatus 100, and a rear display and acamera are disposed on the rear surface of the user terminal apparatus100. The front display and the rear display may be connected with eachother, and the rear display may be smaller than the front display.However, this should not be considered as limiting, and the frontdisplay and the rear display may have the same size. In addition, thecamera may be disposed on the front surface of the user terminalapparatus 100. The front display will be explained as a main displayarea 10 and the rear display will be explained as a sub display area 20.

Referring to FIG. 1B, the left view is a front view showing the entiredisplay in which the main display area 10, the sub display area 20, anda round display area 30 are connected with one another, and the rightview is a rear view of the entire display.

The sub display area 20 may extend from one side of the main displayarea 10 and may be disposed on at least one area of the rear surface ofthe user terminal apparatus 100. In particular, the sub display area 20may extend from the top of the main display area 10 to be bent. The bentarea may have a curved shape, but is not limited to this and may form anangle according to the type of the display.

The round display area 30 is an area for connecting the main displayarea 10 and the sub display area 20. As described above, the rounddisplay area 30 may have a curved shape or an angular shape. The rounddisplay area 30 may be distinguished from the main display area 10 andthe sub display area 20 by boundary lines 30-1, 30-2.

The boundary lines 30-1, 30-2 shown in FIG. 1B are merely an example andmay be changed. In addition, the boundary lines 30-1, 30-2 may bedetermined by a manufacturer at the time of manufacturing, and may bechanged by a user. In response to the boundary lines 30-1, 30-2 beingchanged, the sizes of the main display area 10, the sub display area 20,and the round display area 30 may be changed and the size of a contentdisplayed on each area may be changed.

In FIGS. 1A and 1B, the display encloses the upper side of the userterminal apparatus 100. However, the display may enclose any one of thelower side, the left side surface, and the right side surface of theuser terminal apparatus 100. In addition, the display may enclose aplurality of side surface other than a single side surface.

The display may enclose a touch pad, and the display and the touch padmay be implemented in the form of a touch screen by forming a mutuallayer structure. In this case, the touch pad is also bent similarly tothe display and thus a touch input may be inputted opposite to what theuser thinks. For example, it may be determined that there is adifference in the touch area but the touch is made in the same directionin response to the user dragging from a certain point of the maindisplay area 10 to an upper point and in response to the user draggingfrom a certain point of the sub display area 20 to an upper point.However, since the touch pad is bent, the touch pad may receive theinput in the opposite direction to the real input in response to theuser dragging from a certain point of the main display area 10 to anupper point and in response to the user dragging from a certain point ofthe sub display area 20 to an upper point. Therefore, the user terminalapparatus 100 may be set to recognize the direction of a touch input ata certain area as the opposite direction. This departs from the scope ofthe present disclosure and thus a detailed description thereof isomitted.

Since the main display area 10, the sub display area 20, and the rounddisplay area 30 are connected with one another, various sensors and areceiver may be provided on the side surface or lower portion of theuser terminal apparatus 100. In particular, a directional receiver maybe provided. Alternatively, the receiver may be provided on an integralcover which may interwork with the user terminal apparatus 100. Inresponse to the receiver being provided on the lower portion, aprocessor 130 may reverse the top and bottom of an image and display theimage while the user is talking on the phone.

First, the present disclosure will be explained on the assumption thatthe sub display area 20 has a structure extending from the main displayarea 10 through the round display area 30 of the curved shape, and thecamera is disposed on the rear surface of the user terminal apparatus100. Additionally, various embodiments will be expanded and describedwhen the display has other configurations and the location of the camerais changed.

In addition, the direction of the main display area 10 and the subdisplay area 20 going toward the round display area 30 will be explainedas being upward from the user terminal apparatus 100, and the oppositedirection will be explained as being downward. The left side and theright side will be explained with reference to a display area which isviewed by the user. Accordingly, the left side and the right side whenthe user views the main display area 10 are reversed when the user viewsthe sub display area 20.

FIG. 2A is a block diagram illustrates a configuration of a userterminal apparatus according to an embodiment of the present disclosure.

Referring to FIG. 2A, a user terminal apparatus 100 includes a display110, a camera 120, and a processor 130.

FIG. 2A illustrates overall elements of the user terminal apparatus 100when the user terminal apparatus 100 is provided with various functionssuch as a display function, a control function, and the like.Accordingly, some of the elements shown in FIG. 2A may be omitted orchanged and other elements may be added according to an embodiment.

The display 110 may include a main display area 10 which is disposed onthe front surface of the user terminal apparatus 100, a sub display area20 which extends from one side of the main display area 10 and isdisposed on at least one area of the rear surface of the user terminalapparatus 100, and a round display area 30 for connecting the maindisplay area 10 and the sub display area 20. However, this should not beconsidering as limiting. For example, the sub display area 20 may beconfigured to enclose the entire rear surface of the user terminalapparatus 100.

The terms “front surface” and “rear surface” are used for convenience ofexplanation and are not limited by the meaning thereof. For example, thefront surface and the rear surface may refer to one side surface and theother side surface regarding a specific electronic device. In theabove-described explanation, the display 110 extends from one side ofthe main display area 10. However, this should not be considered aslimiting. For example, the display 110 may extend from all side surfacesof the main display area 10 and cover the entire user terminal apparatus100.

The sub display area 20 of the display 110 may extend from the upperside of the main display area 10 to be bent and may be disposed on theupper area of the rear surface. For example, a connection part betweenthe main display area 10 and the sub display area 20 may be formed inthe shape of “U” and have a curved line when the main display area 10and the sub display area 20 are viewed from the side. However, thisshould not be considered as limiting. The connection part between themain display area 10 and the sub display area 20 may be formed in theshape of a squared “C” and have an angle of 90° when the main displayarea 10 and the sub display area 20 are viewed from the side. Inaddition, various connection parts may be formed based on the type ofthe user terminal apparatus 100.

The display 110 may display various user interfaces (UIs) under thecontrol of the processor 130. For example, the display 110 may display alive view, a gallery application, an animation, and the like.

The display 110 may display different contents on the main display area10, the sub display area 20, and the round display area 30 under thecontrol of the controller 130. For example, the display 110 may displaya moving picture on the main display area 10, an image on the subdisplay area 20, and a UI for transmitting a message on the rounddisplay area 30.

In addition, the display 110 may display a content by interlocking atleast two of the main display area 10, the sub display area 20, and theround display area 30. For example, the display 110 may display a movingpicture on the main display area 10 and display a UI for controlling themoving picture on the sub display area 20. In addition, the display 110may display a UI for providing a function unrelated to the movingpicture on the round display area 30.

In addition, the display 110 may display the same content on at leasttwo of the main display area 10, the sub display area 20, and the rounddisplay area 30. For example, the display 110 may display the samecontent on the main display area 10 and the sub display area 20 and maydisplay a separate content on the round display area 30.

The display 110 may be implemented by using a liquid crystal display(LCD) panel, an organic light emitting diodes (OLED) display, a plasmadisplay panel (PDP), and the like, but is not limited to these. Inaddition, the display 110 may be implemented by using a transparentdisplay, a flexible display, and the like, according to circumstances.

The camera 120 is configured to photograph a still image or a movingpicture under the control of the user. The camera 120 may photograph astill image at a specific time or may continuously photograph a stillimage. The camera 120 provides the acquired image to the display 110,and a live view may be displayed on at least one of the main displayarea 10 and the sub display area 20. The camera 120 may photograph theuser or a background image according to the orientation of the userterminal apparatus 100. The camera 120 may include a plurality ofcameras such as a front camera and a rear camera.

The camera 120 includes a lens, a shutter, an aperture, a solid stateimaging device, an analog front end (AFE), and a timing generator (TG).The shutter adjusts a time at which light reflected from a subjectenters the user terminal apparatus 100, and the aperture adjusts anamount of light entering the lens by mechanically increasing or reducingthe size of an opening through which light enters. The solid stateimaging device outputs an image generated by photo-charge as an electricsignal when the light reflected from the subject accumulates asphoto-charge. The TG outputs a timing signal to read out pixel data ofthe solid state imaging device, and the AFE samples and digitizes theelectric signal outputted from the solid state imaging device.

The processor 130 may control the overall operation of the user terminalapparatus 100.

The processor 130 may control to display a live view acquired throughthe camera 120 on one of the main display area 10 and the sub displayarea 20, and display the live view on the other one of the main displayarea 10 and the sub display area 20 in response to the orientation ofthe user terminal apparatus 100 being changed. The processor 130 maydetermine whether the orientation of the user terminal apparatus 100 ischanged using a gravity sensor, an acceleration sensor, a gyro sensor,and the like. In addition, the processor 130 may determine whether theorientation of the user terminal apparatus 100 is changed by analyzingthe live view acquired by the camera 120. However, this should not beconsidered as limiting. The processor 130 may change the area to displaythe live view by moving or shaking in a specific direction, in additionby changing the orientation of the user terminal apparatus 100.

The processor 130 may display the live view and additionally may displaya guide line. In addition, the processor 130 may display a graphical UI(GUI) for executing a gallery application, a GUI for executing an imagecorrection application, and the like, in addition to a GUI forphotographing.

The processor 130 may display the live view on the main display area 10and may not provide information on the sub display area 20. In responseto the orientation of the user terminal apparatus 100 changing, theprocessor 130 may display the live view on the sub display area 20 andmay not provide information on the main display area 10. The informationmay not be provided in various ways. For example, power may not besupplied to the display 110 or black is displayed on the display 110.

The processor 130 may activate a touch function of the main display area10 while displaying the live view on the sub display area 20 withoutproviding information on the main display area 10. In response todetecting a user touch from the main display area 10, the processor 130may photograph and store an image.

In response to detecting a swipe interaction from a certain point in themain display area 10 in a predetermined direction, the processor 130 maychange a photographing setting value to correspond to the predetermineddirection.

The processor 130 may display the live view on the main display area 10,and, in response to recognizing the live view as including a person'sface, the processor 130 may control the display 110 to display the facearea included in the live view on the sub display area 20.

The processor 130 may crop a part of the live view to correspond to thesize of the sub display area 20 and control the display 110 to displaythe cropped part on the sub display area 20.

In addition, the processor 130 may display the live view on the maindisplay area 10, and, in response to recognizing the live view asincluding a person, the processor 130 may control the display 110 todisplay an animation on the sub display area 20.

The processor 130 may determine a distance to a subject, and, inresponse to determining the distance is shorter than a predetermineddistance, the processor 130 may control the display 110 to display thelive view on the sub display area 20, and, in response to determiningthe distance is longer than the predetermined distance, control thedisplay 110 to display the live view on the main display area 10.

The user terminal apparatus 100 may further include a plurality ofsensors, and the processor 130 may determine whether the orientation ofthe user terminal apparatus 100 is changed based on at least one of alocation and a motion of the user terminal apparatus 100 and a user'sgrip detected by the plurality of sensors.

In addition, in response to determining a person's face is greater thanor equal to a predetermined size being recognized in the live view or inresponse to determining the person's face is greater than or equal tothe predetermined size being recognized, but not recognizing theperson's face afterward, the processor 130 may determine that theorientation of the user terminal apparatus 100 is changed.

FIG. 2B is a block diagram illustrating an example of a detailedconfiguration of a user terminal apparatus according to an embodiment ofthe present disclosure.

Referring to FIG. 2B, a user terminal apparatus 100 includes a display110, a camera 120, a processor 130, a global positioning system (GPS)chip 145, a storage 140, a sensor, a communicator 150, a user interface155, an audio processor 160, a video processor 170, a speaker 180, abutton 181, and a microphone 182. The same elements of FIG. 2B as inFIG. 2A will not be described in detail.

The display 110 may be divided into the main display area 10, the subdisplay area 20, and the round display area 30 as described above. Thedisplay 110 may be implemented by using various types of displays suchas an LCD, an OLED display, a PDP, and the like. The display 110 mayfurther include a driving circuit which is implemented by using anamorphous silicon thin film transistor (a-si TFT), a low temperaturepoly silicon (LTPS) TFT, an organic TFT (OTFT), and the like, and abacklight unit. The display 110 may be combined with a touch sensorincluded in the sensor and may be implemented as a touch screen.

In this case, the touch sensor may include at least one of a touch paneland a pen recognition panel. The touch panel may detect a user's fingergesture input and output a touch event value corresponding to a detectedtouch signal. The touch panel may be mounted under at least one of themain display area 10, the sub display area 20, and the round displayarea 30 of the display 110.

The touch panel may detect the user's finger gesture input in acapacitive method or a resistive method. The capacitive methodcalculates touch coordinates by detecting minute electricity excited ina user's body. The resistive method includes two electrode platesembedded in the touch panel, and calculates touch coordinates bydetecting an electric current flowing due to contact between upper andlower plates at a touched point.

The pen recognition panel may detect a user's pen gesture inputaccording to a user's operation of using a touch pen (e.g., a styluspen, a digitizer pen), and output a pen proximity event value or a pentouch event value. The pen recognition panel may be mounted under atleast one of the main display area 10, the sub display area 20, and theround display area 30 of the display 110.

The pen recognition panel may be implemented in an electromagneticresonance (EMR) method, for example, and may detect a touch or aproximity input according to a change in the intensity of anelectromagnetic field caused by the proximity or touch of the pen.Specifically, the pen recognition panel may include an electromagneticinduction coil sensor (not shown) having a grid structure, and anelectronic signal processor (not shown) which provides an alternatingcurrent (AC) signal having a predetermined frequency to each loop coilof the electromagnetic induction coil sensor in sequence. In response toa pen having a resonant circuit embedded therein existing in theproximity of the loop coil of the pen recognition panel, a magneticfield transmitted from the corresponding loop coil generates a currentin the resonant circuit of the pen based on the mutual electromagneticinduction. Based on the current, an induction magnetic field isgenerated from the coil forming the resonant circuit in the pen, and thepen recognition panel detects the induction magnetic field from the loopcoil in a signal reception state, and thus detects the proximitylocation or touch location of the pen.

The pen recognition panel may be configured differently according to adisplay area. For example, both the touch panel and the pen recognitionpanel may be provided in the main display area 10, and only the touchpanel may be provided in the sub display area 20 and the round displayarea 30.

The processor 130 may deactivate a specific panel by shutting off thepower to the specific panel. In addition, the processor 130 may supplypower to the touch panel and the pen recognition panel and receive atouch or a pen input, but may deactivate a specific panel bydisregarding an input to the specific panel in a software level.

In this case, the processor 130 may receive at least one of a hand touchand a pen touch according to whether the touch panel and the penrecognition panel of the main display area 10 are activated. Forexample, the processor 130 may activate only the touch panel not toreceive the pen touch input and receive only the hand touch input or mayactivate only the pen recognition panel not to receive the hand touchinput and receive only the pen touch input.

In addition, the touch panel and the pen recognition panel may beprovided on the entire display area and the pen recognition panel ofsome areas may be deactivated. For example, the processor 130 maydeactivate only the pen recognition panel corresponding to the subdisplay area 20 and the round display area 30.

The touch panel and the pen recognition panel may be implemented as asingle panel. In this case, the processor 130 may detect a touch inputand a pen input through the entire display area.

In response to the touch panel and the pen recognition panel beingimplemented as a single panel, the processor 130 may perform anoperation corresponding to an input based on at least one of an inputtype and an input area. For example, the processor 130 may disregard aspecific input such as a pen input in a software level. In addition, theprocessor 130 may disregard a pen input to the sub display area 20 in asoftware level.

The processor 130 may control the overall operations of the userterminal apparatus 100 using various programs stored in the storage 140.

Specifically, the processor 130 may include a random access memory (RAM)131, a read only memory (ROM) 132, a main central processing unit (CPU)133, a graphic processor 134, first to n-th interfaces 135-1 to 135-n,and a bus 136.

The RAM 131, the ROM 132, the main CPU 133, the graphic processor 134,and the first to n-th interfaces 135-1 to 135-n may be connected withone another via the bus 136.

The first to n-th interfaces 135-1 to 135-n may be connected with theabove-described various elements. One of the interfaces may be a networkinterface which is connected with an external device via a network.

The main CPU 133 may access the storage 140 and perform booting using anoperating system (O/S) stored in the storage 140. In addition, the mainCPU 133 may perform various operations using various programs stored inthe storage 140.

The ROM 132 may store a set of instructions for booting a system. Inresponse to a turn on command being inputted and power being supplied,the main CPU 133 may copy the O/S stored in the storage 140 into the RAM131 according to a command stored in the ROM 132, and boot the system byexecuting the O/S. In response to the booting being completed, the mainCPU 133 may copy various application programs stored in the storage 140into the RAM 131, and perform various operations by executing theapplication programs copied into the RAM 131.

The graphic processor 134 may generate a screen including variousobjects such as an icon, an image, a text, and the like, using acalculator (not shown) and a renderer (not shown). The calculator (notshown) may calculate attribute values of objects to be displayedaccording to a layout of the screen, such as a coordinate value, ashape, a size, a color, and the like, based on a received controlcommand. The renderer (not shown) may generate the screen of variouslayouts including objects based on the attribute values calculated bythe calculator (not shown). The screen generated by the renderer (notshown) may be displayed in the display area of the display 110.

The above-described operations of the processor 130 may be achieved by aprogram stored in the storage 140.

The storage 140 may store a variety of data such as an O/S softwaremodule for driving the user terminal apparatus 100, a photographingmodule, and an application module.

In this case, the processor 130 may process and display an input imagebased on information stored in the storage 140.

The GPS chip 145 is an element for receiving a GPS signal from a GPSsatellite, and calculating a current location of the user terminalapparatus 100. In response to a navigation program being used or auser's current location being required, the processor 130 may calculatethe user's location using the GPS chip 145.

The communicator 150 is configured to communicate with various kinds ofexternal devices according to various kinds of communication methods.The communicator 150 includes a Wi-Fi chip 151, a Bluetooth chip 152, awireless communication chip 153, and a near field communication (NFC)chip 154. The processor 130 may communicate with various externaldevices using the communicator 150.

In particular, the Wi-Fi chip 151 and the Bluetooth chip 152 communicatein a Wi-Fi method and a Bluetooth method, respectively. When the Wi-Fichip 151 or the Bluetooth chip 152 is used, a variety of connectioninformation such as a service set identifier (SSID) and a session keymay be exchanged first, and communication may be established using theconnection information, and then a variety of information may beexchanged. The wireless communication chip 153 refers to a chip whichcommunicates according to various communication standards such as TheInstitute of Electrical and Electronics Engineers (IEEE), ZigBee, 3rdgeneration (3G), 3G partnership project (3GPP), long term evolution(LTE), and the like. The NFC chip 154 refers to a chip which operates inan NFC method using a band of 13.56 MHz from among various radiofrequency identification (RF-ID) frequency bands such as 135 kHz, 13.56MHz, 433 MHz, 860-960 MHz, and 2.45 GHz.

The communicator 150 may perform unidirectional communication orbidirectional communication with an electronic device. When thecommunicator 150 performs the unidirectional communication, thecommunicator 150 may receive signals from the electronic device. Whenthe communicator 150 performs the bidirectional communication, thecommunicator 150 may receive signals from the electronic device ortransmit signals to the electronic device.

The user interface 155 may receive various types of user interaction.When the user terminal apparatus 100 is implemented by using atouch-based portable terminal, the user interface 155 may be implementedin the form of a touch screen forming a mutual layer structure with atouch pad. In this case, the user interface 155 may be used as theabove-described display 110.

The sensor (not shown) may include a touch sensor, a geomagnetic sensor,a gyro sensor, an acceleration sensor, a proximity sensor, a gripsensor, and the like. The sensor may detect various operations such asrotation, tilt, pressure, approach, grip, and the like. in addition tothe above-described touch.

The touch sensor may be implemented in a capacitive method or aresistive method. The capacitive type touch sensor is a sensor whichcalculates touch coordinates by detecting minute electricity excited ina user's body when a part of the user's body touches the surface of thedisplay, using a dielectric substance coated on the surface of thedisplay. The resistive type touch sensor includes two electrode platesembedded in the user terminal apparatus 100, and, when the user touchesthe screen, calculates touch coordinates by detecting an electriccurrent flowing due to contact between upper and lower plates at thetouched point. In addition, infrared beam, surface acoustic wave,integral strain gauge, piezo electric, and the like, may be used todetect a touch interaction.

In addition, the user terminal apparatus 100 may determine whether atouch object such as a finger or a stylus pen touches or approachesusing a magnetic field sensor, an optical sensor, a proximity sensor,and the like, instead of the touch sensor.

The geomagnetic sensor is a sensor for detecting a rotational state, amoving direction, and the like, of the user terminal apparatus 100. Thegyro sensor is a sensor for detecting a rotational angle of the userterminal apparatus 100. Both the geomagnetic sensor and the gyro sensormay be provided, but, even when only one of them is provided, the userterminal apparatus 100 may detect a rotation state.

The acceleration sensor is a sensor for detecting how the user terminalapparatus 100 is tilted.

The proximity sensor is a sensor for detecting a motion which approacheswithout directly contacting the display surface. The proximity sensormay be implemented by using various types of sensors such as ahigh-frequency oscillation type proximity sensor which forms a highfrequency magnetic field and detects an electric current induced by amagnetic characteristic which is changed when an object approaches, amagnetic type proximity sensor which uses a magnet, and a capacitivetype proximity sensor which detects capacitance that changes when anobject approaches, and the like.

The grip sensor may be disposed on the rear surface, edge, or handlepart separately from the touch sensor provided on the touch screen, anddetects a user's grip. The grip sensor may be implemented as a pressuresensor in addition to the touch sensor.

The audio processor 160 is an element for processing audio data. Theaudio processor 160 may perform various processing operations such asdecoding, amplification, noise filtering, and the like, with respect tothe audio data.

The video processor 170 is an element for processing video data. Thevideo processor 170 may perform various image processing operations suchas decoding, scaling, noise filtering, frame rate conversion, resolutionconversion, and the like, with respect to the video data.

The speaker 180 is an element for outputting not only various audio dataprocessed by the audio processor 160 but also various notificationsounds, voice messages, and the like.

The button 181 may include various types of buttons such as a mechanicalbutton, a touch pad, a wheel, and the like, formed on a certain area ofthe user terminal apparatus 100, such as the front surface, the sidesurface, and the rear surface of the body exterior of the user terminalapparatus 100.

The microphone 182 is an element for receiving an input of a user voiceor other sounds and converting the user voice or sound into audio data.

Although not shown in FIG. 2B, the user terminal apparatus 100 mayfurther include a universal serial bus (USB) port to which a USBconnector is connected, a headset, a mouse, various external input portsfor connecting to various external ports such as a local area network(LAN), a digital multimedia broadcasting (DMB) chip for receiving andprocessing a DMB signal, various sensors, and the like.

FIG. 2C illustrates various modules stored in a storage according to anembodiment of the present disclosure.

The software of FIG. 2C may be stored in the storage 140, but is notlimited to this. The software may be stored in various kinds of storingmeans used in the user terminal apparatus 100.

Referring to FIG. 2C, software including an O/S 191, a kernel 192,middleware 193, an application 194, and the like may be stored in theuser terminal apparatus 100.

The O/S 191 controls and manages the overall operations of hardware.That is, the O/S 191 is a software layer which is responsible for basicfunctions such as hardware management, memory management, and security.

The kernel 192 serves as a channel to transmit various signals includinga touch signal, and the like, detected by the display 110 to themiddleware 193.

The middleware 193 includes various software modules to control theoperations of the user terminal apparatus 100. Referring to FIG. 2C, themiddleware 193 includes a main UI framework 193-1, a window manager193-2, a sub UI framework 193-3, a security module 193-4, a systemmanager 193-5, a connectivity manager 193-6, an X11 module 193-7, an APPmanager 193-8, and a multimedia framework 193-9.

The main UI framework 193-1 is a module which provides various Uls to bedisplayed on the main display area 10 of the display 110, and the sub UIframework 193-3 is a module which provides various Uls to be displayedon the sub display area 20. The main UI framework 193-1 and the sub UIframework 193-3 may include an image compositor module to configurevarious objects, a coordinates compositor module to calculatecoordinates for displaying the objects, a rendering module to render theconfigured objects on the calculated coordinates, a two dimensional(2D)/three dimensional (3D) UI toolkit to provide a tool for configuringa UI in the form of 2D or 3D.

The window manager 193-2 may detect a touch event using a user's body ora pen or other input events. In response to such an event beingdetected, the window manager 193-2 transmits an event signal to the mainUI framework 193-1 or the sub UI framework 193-3 such that an operationcorresponding to the event is performed.

In addition, various program modules such as a writing module which,when the user touches and drags on the screen, draws a line followingthe trace of the dragging, and an angle calculation module whichcalculates a pitch angle, a roll angle, a yaw angle, and the like, basedon a sensor value detected by the sensor, may be stored.

The security module 193-4 is a module which supports certification,permission, and secure storage for hardware.

The system manager 193-5 monitors the states of the elements in the userterminal apparatus 100, and provides the result of the monitoring to theother modules. For example, in response to a battery life level beinglow, an error being generated, or communication being disconnected, thesystem manager 193-5 provides the result of the monitoring to the mainUI framework 183-1 or the sub UI framework 193-3 to output anotification message or a notification sound.

The connectivity manager 193-6 is a module which supports wire orwireless network connection. The connectivity manager 193-6 may includevarious sub modules such as a DNET module, a universal plug and play(UPnP) module, and the like.

The X11 module 193-7 is a module which receives various event signalsfrom a variety of hardware provided in the user terminal apparatus 100.The event recited herein refers to an event in which a user operation isdetected, an event in which a system alarm is generated, an event inwhich a specific program is executed or ends, and the like.

The APP manager 193-8 is a module which manages the execution states ofvarious applications installed in the storage 140. In response to anevent in which an application execution command is inputted beingdetected by the X11 module 193-7, the APP manager 193-8 may call andexecute an application corresponding to the event. That is, in responseto an event in which at least one object is selected being detected, theAPP manager 193-8 may call an application corresponding to the objectand execute the application.

The multimedia framework 193-9 is a module which reproduces multimediacontents which are stored in the user terminal apparatus 100 or providedfrom external sources. The multimedia framework 193-9 may include aplayer module, a camcorder module, a sound processing module, and thelike. Accordingly, the multimedia framework 193-9 may reproduce variousmultimedia contents, generate a screen and a sound, and reproduce thesame.

The software structure shown in FIG. 2C is merely an example and is notlimited to this. Therefore, some of the elements may be omitted orchanged or an element may be added when necessary. For example, thestorage 140 may be additionally provided with various programs such as asensing module to analyze signals sensed by various sensors, a messagingmodule such as a messenger program, a short message service (SMS) andmultimedia message service (MMS) program, and an email program, a callinformation aggregator program module, a voice over internet protocol(VoIP) module, a web browser module, and the like.

As described above, the user terminal apparatus 100 may be implementedby using various kinds of devices such as a mobile phone, a tabletpersonal computer (PC), a laptop PC, a personal digital assistant (PDA),a Moving Picture Experts Group phase 1 or phase 2 (MPEG-1 or MPEG-2)audio layer 3 (MP3) player, an electronic album device, a television(TV), a PC, a kiosk, and the like. Accordingly, the elements describedin FIGS. 2B and 2C may be changed in various ways according to the typeof the user terminal apparatus 100.

As described above, the user terminal apparatus 100 may be implementedin various shapes and configurations.

Hereinafter, a basic configuration and various embodiments will beexplained for easy understanding of the present disclosure.

FIG. 3 illustrates an example of using only one of a main display area,a sub display area, and a round display area according to an embodimentof the present disclosure.

Referring to FIG. 3, the processor 130 may determine an area to provideinformation based on the orientation of the user terminal apparatus 100.In response to the processor 130 providing information to one area, theprocessor 130 may not provide information to the other two areas.

In response to a user input pressing a power button, the processor 130may determine the area to provide information. In addition, in responseto a call or a text message being received, the processor 130 maydetermine the area to provide information.

In the above-described example, the processor 130 determines the area toprovide information based on the orientation of the user terminalapparatus 100. However, this should not be considered as limiting. Forexample, in response to a user input pressing the power button, theprocessor 130 may recognize the user and provide information through anarea which is close to the user's eyes. In this case, the providedinformation may vary according to an executed application

The processor 130 may change the display area to provide informationthrough a user's touch input to the area which no information isprovided. For example, in response to a user input continuing touchingon a certain area of the sub display area 20 being received while theinformation is provided to the main display area 10, the processor 130may display the information provided to the main display area 10 on thesub display area 20.

The processor 130 may display the same information in different waysaccording to the area to display the information. For example, theprocessor 130 may change the layout of a home screen according to thedisplay area as shown in FIG. 3.

In response to the orientation of the user terminal apparatus 100 beingchanged, the processor 130 may change the area to display information.For example, in response to the user terminal apparatus 100 beingrotated by more than a predetermined angle while the home screen isbeing displayed on the main display area 10, the processor 130 maydisplay the home screen on the sub display area 20.

In particular, in response to the orientation of the user terminalapparatus 100 being changed and thus the display area being changed, theprocessor 130 may change the layout of information to be provided. Inresponse to the area to provide information being changed, the processor130 may change not only an object but also the size, content, and layoutof the object.

In response to the orientation of the user terminal apparatus 100 beingchanged and thus the display area being changed, the processor 130 maychange the operation state of an application which is being executed andprovide the application to another display area. In addition, inresponse to the orientation of the user terminal apparatus 100 beingchanged, the processor 130 may divide displayed information and displaydivided pieces of information on the other display areas.

FIG. 4 illustrates an example of using at least two areas of a maindisplay area, a sub display area, and a round display area according toan embodiment of the present disclosure.

Referring to FIG. 4, the processor 130 may provide pieces of informationrelated to each other to two areas of the main display area 10, the subdisplay area 20, and the round display area 30. For example, theprocessor 130 may display a moving picture on the main display area 10and may display a UI for controlling the moving picture on the rounddisplay area 30.

However, this should not be considered as limiting. The processor 130may provide pieces of information unrelated to each other to two areasof the main display area 10, the sub display area 20, and the rounddisplay area 30.

In addition, in response to a call being received while the UI forcontrolling the moving picture is displayed on the round display area 30as shown in FIG. 4, the processor 130 may display a call reception UI onthe round display area 30, and move the UI for controlling the movingpicture to the sub display area 20 and display the UI on the sub displayarea 20.

In response to the call being connected by touching the call receptionUI, the processor 130 may display a telephone call UI on the rounddisplay area 30 and continue reproducing the moving picture. In thiscase, the processor 130 may mute the moving picture. In addition, theprocessor 130 may pause the moving picture.

The processor 130 may provide pieces of information related to eachother using all of the main display area 10, the sub display area 20,and the round display area 30. For example, the processor 130 maydisplay a moving picture on the main display area 10, display a UI forcontrolling the moving picture on the sub display area 20, and display aUI showing a moving picture reproduction time on the round display area30.

In addition, the processor 130 may provide pieces of informationunrelated to each other using all of the main display area 10, the subdisplay area 20, and the round display area 30. In addition, theprocessor 130 may provide pieces of information related to each other totwo areas of the main display area 10, the sub display area 20, and theround display area 30, and provide information unrelated to theaforementioned information to the other area.

In response to the orientation of the user terminal apparatus 100 beingchanged, the processor 130 may change the display area of informationdisplayed on each area. In particular, the processor 130 may change thedisplay area by combining or dividing information displayed on eacharea.

In response to a touch input on the sub display area 20 being received,the processor 130 may display a UI displayed on the sub display area 20on the main display area 10. In addition, in response to a touch inputon the main display area 10 being received, the processor 130 maydisplay a UI displayed on the main display area 10 on at least one ofthe sub display area 20 and the round display area 30.

Even in response to the same user touch input being detected, theprocessor 130 may differently adjust a setting value according to atouch area. For example, in response to a drag operation being inputtedto the main display area 10 or the sub display area 20 while a movingpicture is being displayed on the main display area 10, the processor130 may adjust a reproduction time or a volume according to thedirection of the drag operation. In this case, in response to the dragoperation on the sub display area 20, the processor 130 may adjust thereproduction time or volume more minutely than in response to the dragoperation on the main display area 10.

FIG. 4 is merely an embodiment and this should not be considered aslimiting. For example, the main display area 10, the sub display area20, and the round display area 30 of FIG. 4 may be replaced with oneanother. In addition, the operations described in FIG. 4 may be appliedto any other applications.

FIG. 5 illustrates respective areas and an example of an operationcorresponding to a touch input according to an embodiment of the presentdisclosure.

Referring to FIG. 5, in response to a drag input going from a certainarea of the main display area 10 to the round display area 30 beingreceived, the processor 130 may display information provided on the maindisplay area 10 on the sub display area 20.

Only in response to a drag input going longer than a predeterminedlength being received, the processor 130 may display the informationprovided on the main display area 10 on the sub display area 20.

In response to there being information provided on the sub display area20 before the drag input is received, the processor 130 does not providethe information provided on the sub display area 20 any longer. Inaddition, the processor 130 may display the information provided on thesub display area 20 on the main display area 10 or the round displayarea 30.

In FIG. 5, only the main display area 10 and the sub display area 20 areused. However, this should not be considered as limiting. For example,the processor 130 may display information provided on at least one ofthe main display area 10 and the sub display area 20 on the rounddisplay area 30. In addition, the processor 130 may display informationprovided on the round display area 30 on at least one of the maindisplay area 10 and the sub display area 20.

Although information is not provided on a specific area, the processor130 may receive a touch input. For example, in response to a userdragging input on the round display area 30 being received while abroadcast content is being displayed on the main display area 10, theprocessor 130 may change a channel or a volume of the broadcast content.In this case, no information may be provided on the round display area30.

FIG. 6 illustrates an operation in response to the orientation of a userterminal apparatus being changed according to an embodiment of thepresent disclosure.

Referring to FIG. 6, the user terminal apparatus 100 includes a display110, which includes a main display area 10 which is disposed on thefront surface of the user terminal apparatus 100, a sub display area 20which extends from one side of the main display area 10 and is disposedon at least one area of the rear surface of the user terminal apparatus100, and a round display area 30 for connecting the main display area 10and the sub display area 20.

The user terminal apparatus 100 may be provided with a camera 120disposed on the rear surface thereof to photograph. The structure of theuser terminal apparatus 100 having the camera 120 disposed on the rearsurface thereof will be explained first for convenience of explanation.The structure of the user terminal apparatus 100 having the camera 120disposed on the front surface thereof will be explained thereafter.

The processor 130 may display a live view which is acquired through thecamera 110 on one of the main display area 10 and the sub display area20. The upper view of FIG. 6 illustrates that the processor 130 displaysa live view on the main display area 10. In addition, the processor 130may display the live view on the sub display area 20, and a method fordetermining which of the main display area 10 and the sub display area20 is the area to display the live view will be explained below.

In response to the orientation of the user terminal apparatus 100 beingchanged, the processor 130 may control the display 110 to display thelive view on the other one of the main display area 10 and the subdisplay area 20. The lower view of FIG. 6 illustrates that, in responseto a rotation by more than a predetermined angle in a specific directionbeing detected while the live view is being displayed on the maindisplay area 10, the processor 130 displays the live view on the subdisplay area 20. The image photographed by the camera 120 may also bechanged in response to the orientation of the user terminal apparatus100 being changed. The processor 130 may determine that the orientationof the user terminal apparatus 100 is changed in various methods, and adetailed description thereof will be explained below.

In response to the orientation of the user terminal apparatus 100 beingchanged and thus the area to display the live view being changed, theprocessor 130 may display a soft key, a control GUI, and the like, tocorrespond to the corresponding area. For example, in response to thelive view being displayed on the main display area 10, the processor 130may display a GUI for photographing on the right side of the maindisplay area 10. In addition, in response to the orientation of the userterminal apparatus 100 being changed and thus the live view beingdisplayed on the sub display area 20, the processor 130 may not displaythe GUI for photographing and may photograph in response to a touch onthe sub display area 20.

In response to the orientation of the user terminal apparatus 100 beingchanged while the live view is being displayed on the sub display area20, the processor 130 may display a photographing setting value on themain display area 10.

The processor 130 may display the live view on the main display area 10and may not provide information on the sub display area 20, and, inresponse to the orientation of the user terminal apparatus 100 beingchanged, the processor 130 may display the live view on the sub displayarea 20 and may not provide information on the main display area 10. Forexample, in the case of the upper view of FIG. 6, the processor 130 maynot provide information on the sub display area 20. In addition, in thecase of the lower view of FIG. 6, the processor 130 may not provideinformation on the main display area 10. However, this should not beconsidered as limiting. The processor 130 may display the live view onboth the main display area 10 and the sub display area 20.

The processor 130 may not provide information by displaying one of themain display area 10 and the sub display area 20 in black. In addition,the processor 130 may not supply power to the display 110 of one of themain display area 10 and the sub display area 20. Although the processor130 may not provide information on one of the main display area 10 andthe sub display area 20, the processor 130 may activate a touch functionto receive a touch input.

In response to the orientation of the user terminal apparatus 100 beingchanged, the processor 130 may change a photographing mode. For example,in response to the orientation of the user terminal apparatus 100 beingchanged and thus a subject being recognized as being close to the userterminal apparatus 100, the processor 130 may convert a current modeinto a selfie photographing mode. The selfie photographing mode is amode optimized to selfie photographing and may correct user's skinautomatically.

In addition, in response to the orientation of the user terminalapparatus 100 being changed and thus a subject being recognized as beingfar from the user terminal apparatus 100, the processor 130 may converta current mode into a background photographing mode. The backgroundphotographing mode is a mode optimized to scene photographing and mayadjust contrast and white balance automatically.

The processor 130 may change an angle of view according to aphotographing mode. For example, the processor 130 may narrow the angleof view in the selfie photographing mode and may widen the angle of viewin the background photographing mode.

In addition, the processor 130 may change a UI provided on the displayaccording to a photographing mode. For example, the processor 130 mayprovide a UI including a function of correcting user's skin and afunction of reducing a red-eye effect in the selfie photographing mode,and may provide a UI including a contrast adjustment function and awhite balance adjustment function in the background photographing mode.

FIGS. 7A and 7B illustrate an example of a method of changing a providedimage according to a display area according to various embodiments ofthe present disclosure.

Referring to FIG. 7A, the processor 130 may display a live view on themain display area 10. In response to the user doing a photographingmanipulation, the processor 130 may store the same image as the imagedisplayed on the main display area 10.

In addition, referring to FIG. 7B, the processor 130 may display thelive view on the sub display area 20. In this case, the processor 130may display only a part of the image which is recognized through thecamera 120.

FIGS. 7A and 7B illustrate that the same subject is photographed forconvenience of explanation. That is, the processor 130 may photographthe image shown in FIG. 7A, but may display only a part of thephotographed image on the sub display area 20 as shown in FIG. 7B.

However, this is merely an embodiment, and the processor 130 may rotatethe photographed entire image by 90° and display the image on the subdisplay area 20.

In addition, even in response to photographing being performed while thelive view is being displayed on the sub display area 20, the processor130 may store the entire image. For example, even in response to theuser performing selfie photographing with the composition shown in FIG.7B, the processor 130 may photograph an original image including notonly the user's face but also the user's upper body as shown in FIG. 7A.

In this case, a gallery application may be executed and the processor130 may display the stored image differently according to a displayarea. For example, in response to the image being displayed on the maindisplay 10, the processor 130 may display the original image includingthe user's upper body. In response to the image being displayed on thesub display area 20, the processor 130 may display a partial imageincluding only the user's face.

The processor 130 may store both the original image and the partialimage. In addition, the processor 130 may store only the original image,and may crop the image to correspond to the sub display area 20 whennecessary and display the image on the sub display area 20. In thiscase, the original image may store information on a part to be cropped.

FIGS. 8A and 8B illustrate an example of a method of executing aspecific function through a main display area according to variousembodiments of the present disclosure. The processor 130 may display alive view on the sub display area 20 and may not provide information onthe main display area 10. In this case, the processor 130 may execute acorresponding function according to a user touch input on the maindisplay area 10.

Referring to FIG. 8A, photographing an image using the main display area10 is illustrated. For example, the processor 130 may display a liveview on the sub display area 20 and may not provide information on themain display area 10. In this case, in response to a user touch on themain display area 10 being detected, the processor 130 may photographand store an image.

The processor 130 may photograph the image only in response to a usertouch on a predetermined area 11 of the main display area 10 beingdetected. The predetermined area 11 may be set by the manufacturer ormay be set by the user. In this case, the processor 130 may activate atouch function of the predetermined area 11 of the main display area 10and may deactivate a touch function of the other area of the maindisplay area 10.

Referring to FIG. 8B, changing a photographing setting value using themain display area 10 is illustrated. For example, the processor 130 maydisplay a live view on the sub display area 20 and may not provideinformation on the main display area 10. In this case, in response to aswipe interaction from a certain point in the main display area 10 in apredetermined direction being detected, the processor 130 may change aphotographing setting value to correspond to the predetermineddirection.

The processor 130 may change the photographing setting value only inresponse to a swipe interaction from a certain point in thepredetermined area 11 of the main display area 10 in a predetermineddirection being detected. The predetermined area may be set by themanufacturer or may be set by the user. In this case, the processor 130may activate the touch function of the predetermined area 10 of the maindisplay area 10 and deactivate the touch function of the other area ofthe main display area 10.

In response to a swipe interaction in the horizontal direction 810-1,810-2 being detected, the processor 130 may change an exposure value anddisplay the live view. In response to a swipe interaction in thevertical direction 820-1, 820-2 being detected, the processor 130 maydisplay the live view while zooming in or zooming out. However, thisshould not be considered as limiting. The processor 130 may change afocus or change white balance through the swipe interaction.

In FIGS. 8A and 8B, only the predetermined area 11 of the main displayarea 10 has been described. However, this should not be considered aslimiting. For example, the processor 130 may activate the touch functionof the entire main display area 10, and photograph in response to a usertouch on a certain point of the main display area 10 being detected. Inaddition, the processor 130 may divide the main display area 10 into aplurality of predetermined areas, and may allocate different functionsto the predetermined areas.

The processor 130 may execute corresponding functions in response tovarious interactions, such as a drag and drop interaction, a multi-touchinteraction, and a stretch interaction which refers to pinching out, inaddition to the touch and the swipe interaction. The interactions andcorresponding functions thereof may be set by the manufacturer or may beset by the user.

In FIGS. 8A and 8B, the processor 130 executes a specific function inresponse to a touch on the main display area 10. However, this shouldnot be considered as limiting. For example, the processor 130 maydisplay a live view on the main display area 10 and may not provideinformation on the sub display area 20. In this state, in response to auser touch on the sub display area 20 being detected, the processor 130may photograph and store an image. In addition, in response to a swipeinteraction from a certain point in the sub display area 20 in apredetermined direction being detected, the processor 130 may change thephotographing setting value to correspond to the predetermineddirection.

In addition, the processor 130 may display the live view on both themain display area 10 and the sub display area 20, and may use the areaon the opposite side to the area which is viewed by the user as an areato receive a touch input.

In FIGS. 8A and 8B, only the case in which the camera 120 is used hasbeen described. However, in response to another application being used,the processor 130 may receive a touch input using the area on theopposite side to the area which is viewed by the. For example, whiledisplaying a broadcast content on the main display area 10, theprocessor 130 may change a channel or a volume through a swipeinteraction on the sub display area 20.

In addition, in FIGS. 8A and 8B, only the main display area 10 and thesub display area 20 are used. However, one of the main display area 10and the sub display area 20 and the round display area 30 may be used.For example, while displaying a live view on the sub display area 20,the processor 130 may photograph according to a user touch input on theround display area 30.

FIG. 9 illustrates a method of displaying a live view on both a maindisplay area and a sub display area according to an embodiment of thepresent disclosure.

Referring to FIG. 9, the processor 130 may display a live view on themain display area 10, and, in response to the live view being recognizedas including a person's face, the processor 130 may control the display110 to display a face area included in the live view on the sub displayarea 20. For example, in response to the user terminal apparatus beingfar from a subject, the processor 130 may display the live view on themain display area 10. This will be explained in detail below.

The processor 130 may recognize a user's face from the live viewdisplayed on the main display area 10. To recognize the person's faceusing the live view, the processor 130 may divide a specific still imageof the live view into a plurality of pixel blocks, and calculates arepresentative pixel value from each of the pixel blocks. Therepresentative pixel value may be calculated based on an average of allpixels included in the pixel block or may be calculated based on amaximum distribution value, a median value, or a maximum value. Theprocessor 130 may compare the representative pixel values of the pixelblocks with one another, and determine whether pixel blocks having pixelvalues falling within a similar range are continuously arranged. Inresponse to the pixel blocks being continuously arranged, the processor130 may determine that those pixel blocks form a single object. Theprocessor 130 may determine whether there exists an object having pixelvalues falling within a range similar to person's skin from among thepixel blocks determined to be the objects. In response to such an objectexisting, the processor 130 may recognize the object as a user's facearea or other body areas, and determine the other objects as abackground.

The processor 130 may crop a part 910 of the live view to correspond tothe size of the sub display area 20, and control the display 110 todisplay the part 910 on the sub display area 20. In particular, theprocessor 130 may crop the part 910 of the live view while maintain theaspect ratio of the sub display area 20. The processor 130 may crop thepart 910 of the live view such that the face area included in the liveview is located on the center of the sub display area 20. In addition,the processor 130 may crop an area smaller than the part 910 of the liveview shown in FIG. 9, and may magnify the cropped area and display thearea on the sub display area 20.

In response to the live view being recognized as including people'faces, the processor 130 may display the closest person's face area tothe user from among the people' faces on the sub display area 20. Inaddition, the processor 130 may display a face area of a person whokeeps his/her eyes toward the user terminal apparatus 100 from among thepeople's faces on the sub display area 20. In addition, the processor130 may crop a part of the live view to show all peoples. In response tothe live view including many people, the processor 130 may display thelive view on the sub display area 20 without cropping. Accordingly, theuser who photographs using the user terminal apparatus 100 may identifyan image to be photographed through the live view displayed on the maindisplay area 10, and people who are photographed may identify an imageto be photographed through a part of the live view which is cropped anddisplayed on the sub display area 20.

In FIG. 9, the operation of displaying the live view on both the maindisplay area 10 and the sub display area 20 has been described. However,this should not be considered as limiting. For example, in response tothe user terminal apparatus 100 being operated in a selfie photographingmode, the processor 130 may display the live view on the sub displayarea 20 and may display a UI informing that selfie photographing is inprogress on the main display area 10.

FIG. 10 illustrates a method of displaying a live view on a main displayarea and displaying a specific content on a sub display area accordingto an embodiment of the present disclosure.

Referring to FIG. 10, the processor 130 may display a live view on themain display area 10, and, in response to the live view being recognizedas including a person, the processor 130 may control the display 110 todisplay an animation on the sub display area 20. For example, inresponse to a child being recognized in the live view, the processor 130may display an animation for children or an animal image on the subdisplay area 20. The processor 130 may output a sound corresponding tothe content displayed on the sub display area 20. Accordingly, the eyesof the person who is photographed may be kept toward the user terminalapparatus 100.

The processor 130 may determine a content to be displayed on the subdisplay area 20 based on at least one of age and sex of a person who isrecognized in the live view. For example, in response to a woman beingrecognized in the live view, the processor 130 may display jewelry, andthe like, on the sub display area 20.

In response to people being recognized in the live view, the processor130 may determine a content to be displayed on the sub display area 20with reference to the closest person from among the people. In addition,the processor 130 may determine a content to be displayed on the subdisplay area 20 with reference to a person who keeps his/her eyes onother direction rather than toward the user terminal apparatus 100. Inaddition, the processor 130 may determine a content to be displayed onthe sub display area 20 with reference to a person which is locatedclosest to the center of the live view.

In FIGS. 9 and 10, the case in which a person or person's face isrecognized in the live view has been described. However, this should notbe considered as limiting. For example, even in response to an animalbeing recognized in the live view, the processor 130 may display a partof the live view, an animation, and the like, on the sub display area20. In addition, the processor 130 may display a part of the live view,an animation, and the like, on the sub display area 20 according touser's manipulation.

FIGS. 11A and 11Billustrate an example of a method of determining anarea to display a live view according to various embodiments of thepresent disclosure. The processor 130 may determine a distance to asubject, and, in response to the determined distance being shorter thana predetermined distance, the processor 130 may control the display 110to display the live view on the sub display area 20, and, in response tothe determined distance being longer than the predetermined distance,control the display 110 to display the live view on the main displayarea 10.

Referring to FIGS. 11A and 11B, a case in which a distance to a subjectis shorter than the predetermined distance is illustrated in FIG. 11A,and a case in which a distance to a subject is longer than thepredetermined distance is illustrated in FIG. 11B. The processor 130 maydetermine the distance to the subject using auto focusing. In addition,the processor 130 may analyze a still image at a specific point of timeof the live view, and determine the distance to the subject based on anoutline of the subject. Accordingly, in response to the userphotographing himself/herself while viewing the rear surface of the userterminal apparatus 100, the live view may be displayed on the subdisplay area 20 so that the user may photograph while checking an imageto be photographed. In addition, in response to the user photographingother people or a scene while viewing the front surface of the userterminal apparatus 100, the live view may be displayed on the maindisplay area 10, so that the user may photograph while checking an imageto be photographed.

However, this should not be considered as limiting. The processor 130may display the live view on the opposite area to the area determined inthe above-described method or may display the live view on both the maindisplay area 10 and the sub display area 20.

In addition, the processor 130 may display the live view on an areawhere a user's touch is performed.

In addition, the processor 130 may determine the area to display thelive view by analyzing an image photographed by the camera 120. Forexample, the processor 130 may recognize the user from the photographedimage and determine the area to display the live view.

In addition, the processor 130 may determine the area to display thelive view by recognizing user's iris.

FIG. 12 illustrates a method of detecting a change in an orientation ofa user terminal apparatus according to an embodiment of the presentdisclosure.

Referring to FIG. 12, in response to an orientation of the user terminalapparatus 100 being changed, an image of a live view may be changed. Theuser terminal apparatus 100 may include a plurality of sensors asdescribed above. The processor 130 may determine whether the orientationof the user terminal apparatus 100 is changed based on at least one of alocation and a motion of the user terminal apparatus 100 and a user'sgrip, which are detected by the plurality of sensors. For example, theprocessor 130 may determine whether the orientation of the user terminalapparatus 100 is changed based on a rotation state and a movingdirection of the user terminal apparatus 100 detected by the geomagneticsensor, and a rotation angle of the user terminal apparatus 100 detectedby the gyro sensor.

In response to the user terminal apparatus 100 being rotated in aspecific direction by more than a predetermined angle, the processor 130may determine that the orientation of the user terminal apparatus 100 ischanged. For example, in response to the user terminal apparatus 100being rotated by more than 90°, the processor 130 may determine that theorientation of the user terminal apparatus 100 is changed and perform acorresponding operation.

In response to a person's face being greater than or equal to apredetermined size being recognized in the live view or in response tothe person's face being greater than or equal to the predetermined sizebeing recognized, but the person's face not being recognized afterward,the processor 130 may determine that the orientation of the userterminal apparatus 100 is changed. FIG. 12 illustrates a plurality ofstill images of a live view in sequence. The first still image 1210 isan image without a person and the second to fourth still images 1220,1230 and 1240 are images with a person. The fifth image 1250 is an imagewithout a person. That is, FIG. 12 illustrates that a camera angle ismoved from the left to the right and then is moved back to the left.

The processor 130 may determine that the orientation of the userterminal apparatus 100 is changed at the time at which the second stillimage 1220 is displayed and at the time at which the fifth still image1250 is displayed as shown in FIG. 12.

However, this should not be considered as limiting. The processor 130may determine whether the orientation of the user terminal apparatus 100is changed with reference to other objects rather than the person'sface. For example, the processor 130 may extract an outline of a slidefrom a specific still image of the live view and then extract theoutline of the slide from the next still image, and, in response to theoutline of the slide being recognized as being moved by more than apredetermined distance on the live view, the processor 130 may determinethat the orientation of the user terminal apparatus 100 is changed.

In addition, the processor 130 may continue detecting an absoluteposture using various sensors provided in the user terminal apparatus100, and determine whether the orientation of the user terminalapparatus 100 is changed.

In this case, the processor 130 may set a reference posture, and, inresponse to the posture being changed from the reference posture by morethan a predetermined value, the processor 130 may determine that theorientation of the user terminal apparatus 100 is changed. Herein, thereference posture is a posture when a camera application is selected.

In addition, the processor 130 may determine whether the orientation ofthe user terminal apparatus 100 is changed according to user's touchmanipulation.

FIGS. 13A and 13B illustrate an example of an operation according to thechange of an orientation of a user terminal apparatus according tovarious embodiments of the present disclosure.

Referring to FIG. 13A, in response to an orientation of the userterminal apparatus 100 being changed while a photographing function isbeing executed, a gallery application is executed. For example, theprocessor 130 may display a live view on the sub display area 20, and,in response to the user terminal apparatus 100 being rotated by about180°, the processor 130 may display the gallery application on the maindisplay area 10. In addition, the processor 130 may display a telephonyfunction, an Internet function, and the like, unrelated to thephotographing function on the main display area 10. In addition, theprocessor 130 may stop the photographing function.

In addition, in response to the user touching the main display area 10in the state in which photographing is performed and a stored image isdisplayed on the sub display area 20, the processor 130 may display thegallery application or an application for correcting on the sub displayarea 20. In addition, in response to photographing being performed, theprocessor 130 may display the photographed images on the sub displayarea 20 in sequence, and, in response to the user touching the maindisplay area 10, may change and display the image.

Referring to FIG. 13B response to the orientation of the user terminalapparatus 100 being changed while a moving picture photographingfunction is being executed, the moving picture photographing function isstopped. The upper view of FIG. 13B illustrates a photographing time, aGUI 1310 for stopping photographing the moving picture, and a GUI 1320for pausing photographing the moving picture. The user may touch the GUI1310 for stopping photographing the moving picture to stop photographingthe moving picture. However, the user may change the orientation of theuser terminal apparatus 100 to stop photographing the moving picture.The lower view of FIG. 13B illustrates a thumbnail image of the movingpicture after photographing is finished, and the user may touch a GUI1330 for executing the moving picture to execute the moving picture.

However, this should not be considered as limiting. The processor 130may pause or stop photographing the moving picture in response to atouch on the main display area 10 while the moving picture is beingphotographed.

FIGS. 14A and 14B illustrate an example of a method of executing aphotographing function. The processor 130 may execute the photographingfunction in other ways rather than by touching an icon indicating thephotographing function.

Referring to FIG. 14A, in response to the orientation of the userterminal apparatus 100 being changed, the photographing function isexecuted. For example, in response to the orientation of the userterminal apparatus 100 being changed while a lock screen is beingdisplayed on the main display area 10, the processor 130 may execute thephotographing function and display a live view on the sub display area20. In addition, in response to the orientation of the user terminalapparatus 100 being changed while information is not being provided onthe main display area 10, the processor 130 may execute thephotographing function and display a live view on the sub display area20.

Referring to FIG. 14B, in response to a swipe interaction on the subdisplay area 20 being detected, the photographing function is executed.For example, in response to the swipe interaction on the sub displayarea 20 being detected while the lock screen is being displayed on thesub display area 20 or information is not being provided on the subdisplay area 20, the processor 130 may execute the photographingfunction. FIG. 14B illustrates the swipe interaction moving from theleft to the right. However, the swipe interaction is not limited to aspecific direction. In addition, the photographing function may beexecuted through other interactions than the swipe interaction.

The photographing function may be executed in various ways in additionto the ways in the embodiments of FIGS. 14A and 14B. For example, inresponse to at least one of the main display area 10 and the sub displayarea 20 being activated while information is not being provided on themain display area 10 and the sub display area 20, the processor 130 mayrecognize a user's intention and execute the photographing function. Theprocessor 130 may recognize at least one of a user's face, a user'sgesture, and a grip form at the time when a specific area is activated,and execute the photographing function. For example, in response to theuser making a V sign with user's fingers, the processor 13 may executethe photographing function.

FIG. 15 is a view to illustrate a method of using a round display areaaccording to an embodiment of the present disclosure.

Referring to FIG. 15, the round display area 30 is disposed between themain display area 10 and the sub display area 20. The round display area30 may display a UI for controlling the user terminal apparatus 100. Forexample, in response to the photographing function being activated, theprocessor 130 may display a GUI 1520 for photographing and storing animage on the round display area 30. In response to the user touching theGUI 1520 for photographing and storing the image, the processor 130 mayphotograph and store the image.

In response to a swipe interaction in the horizontal direction 1510-1,1510-2 on the round display area 30 being detected, the processor 130may change an exposure value and display a live view. In addition, theprocessor 130 may display the live view by zooming in or zooming out.However, this should not be considered as limiting. The processor 130may change a focus or change white balance through a swipe interaction.

However, this should not be considered as limiting. In response to theswipe interaction on the round display area 30 being detected, theprocessor 130 may execute the photographing function. In addition, theprocessor 130 may change the area to display the live view in responseto a touch on the round display area 30.

The processor 130 may display a specific notification on the rounddisplay area 30. For example, in response to a subject being out offocus, the processor 130 may display a notification to inform thecorresponding situation on the round display area 30. In response to theuser touching the notification, the processor 130 may change settings tofocus on the subject or retry photographing.

FIG. 16 is a view to illustrate a user terminal apparatus which has acamera disposed on a front surface thereof according to an embodiment ofthe present disclosure.

Referring to FIG. 16, the user terminal apparatus 100 may include thecamera 120 disposed under the main display area 10. However, most of theoperations described in the above-described embodiments are equallyapplied except that the main display area 10 and the sub display area 20are reversed. Therefore, a detailed description is omitted.

In the above descriptions, the camera application has been mainlydescribed. However, similar operations may be performed for otherapplications.

FIGS. 17A to 17C are views to illustrate an example of a case in whichother applications are used according to various embodiments of thepresent disclosure.

Referring to FIG. 17A, in response to an event occurring, the processor130 may determine a display area based on the orientation of the userterminal apparatus 100 at the time when the event occurs. For example,in response to a call or a message being received, the processor 130 maydetect an absolute posture of the user terminal apparatus 100 at thetime when the call or message is received, and display contents of thecall or message on a predetermined display area. In particular, inresponse to the main display area 10 being in contact with a table, theprocessor 130 may display the contents of the call or message on the subdisplay area 20.

In addition, referring to FIG. 17B, in response to an event occurring,the processor 130 may determine a display area based on a user'slocation at the time when the event occurs. For example, in response toa call or a message being received, the processor 130 may recognize theuser's location at the time when the call or message is received throughthe camera 120, and, in response to the user's location beingrecognized, the processor 130 may display the contents of the call ormessage on the sub display area 20, and, in response to the user'slocation not being recognized, the processor 130 may display thecontents of the call or message on the main display area 10.

In addition, referring to FIG. 17C, in response to an event occurring,the processor 130 may determine a display area based on a using state ofthe user terminal apparatus 100 at the time when the event occurs. Forexample, in response to a call or a message being received while theuser is viewing a moving picture through the main display area 10, theprocessor 130 may display the contents of the call or message on the subdisplay area 20 or the round display area 30.

In response to the orientation of the user terminal apparatus 100 beingchanged, the processor 130 may change a display area. For example, inresponse to the user changing the orientation of the user terminalapparatus 100 in the middle of viewing contents of a text messagethrough the main display area 10, and then viewing the sub display area20, the processor 130 may display the contents of the text message onthe sub display area 20.

As described above, the processor 130 may determine whether theorientation of the user terminal apparatus 100 is changed using varioussensors or the camera 120. The change of the orientation of the userterminal apparatus 100 has been described in detail and thus a redundantexplanation thereof is omitted.

In response to the orientation of the user terminal apparatus 100 beingchanged and thus the display area being changed, the processor 130 maychange a UI. Specifically, the processor 130 may change at least one ofan amount of information, an information type, and a layout included inthe UI. For example, in response to a text message being displayed onthe main display area 10, the processor 130 may additionally display aUI for creating a new text message, information on the other user, andthe like, in addition to the contents of the text message. In addition,in response to the text message being displayed on the sub display area20, only the contents of the text message may be displayed. In addition,in response to the text message being displayed on the round displayarea 30, the processor 130 may display some contents of the text messagein sequence.

In particular, the processor 130 may change a function to provideaccording to a display area. For example, in response to the receivedtext message being displayed on the main display area 10, the processor130 may display a UI including a reply message input function, areceived message storing function, a received message deleting function,and the like. However, in response to the received text message beingdisplayed on the round display area 30, only the contents of thereceived text message may be displayed and other functions may not beprovided.

FIGS. 18A and 18B illustrate an example of a configuration of a displayaccording to various embodiments of the present disclosure.

Referring to FIG. 18A, a flexible display is illustrated. The user mayfold the flexible display and use the same. In this case, an area 1810which is folded and bent back corresponds to the sub display area 20,and an unfolded area 1820 corresponds to the main display area 10.

In FIG. 18A, the folded area 1810 is smaller than the unfolded area1820. However, this should not be considered as limiting. For example,the user may fold the flexible display in half and use the same.

Most of the embodiments described above may be applied to the flexibledisplay except for the round display area 30, and a redundantexplanation is omitted. However, the round display area 30 may be formedby folding the flexible display two times. In this case, the embodimentsof the round display area 30 may be applied.

Referring to FIG. 18B, the user terminal apparatus 100 which is providedwith a plurality of displays on the front surface and the rear surfacethereof is illustrated. In this case, a front display 1830 correspondsto the main display area 10, and a rear display 1840 corresponds to thesub display area 20. Likewise, most of the embodiments described abovebe applied to the user terminal apparatus 100 having the plurality ofdisplays disposed on the front surface and the rear surface thereofexcept for the round display area 30, and a redundant explanation isomitted.

FIG. 19 is a flowchart to illustrate a control method of the userterminal apparatus according to an embodiment of the present disclosure.

Referring to FIG. 19, first, the user terminal apparatus 100 displays alive view acquired through a camera on one of a main display area whichis disposed on the front surface of the user terminal apparatus, and asub display area which extends from one side of the main display areaand is disposed on at least one area of the rear surface of the userterminal apparatus 100 at operation S1910. In addition, in response tothe orientation of the user terminal apparatus 100 being changed, theuser terminal apparatus 100 displays the live view on the other one ofthe main display area and the sub display area at operation S1920.

The displaying on one of the main display area and the sub display areaat operation S1910 may include displaying the live view on the maindisplay area and not providing information on the sub display area, andthe displaying on the other one of the main display area and the subdisplay area at operation S1920 may include, in response to theorientation of the user terminal apparatus being changed, displaying thelive view on the sub display area and not providing information on themain display area.

The displaying on the other one of the main display area and the subdisplay area at operation S1920 may include: displaying the live view onthe sub display area and not providing information on the main displayarea; and may further include, in response to a user touch on the maindisplay area being detected, include photographing and storing an image.

The control method may further include, in response to a swipeinteraction from a certain point in the main display area in apredetermined direction being detected, changing a photographing settingvalue to correspond to the predetermined direction.

The displaying on the other one of the main display area and the subdisplay area at operation S1920 may further include: displaying the liveview on the main display area; and, in response to the live view beingrecognized as including a person's face, displaying a face area includedin the live view on the sub display area.

The displaying on the sub display area may include cropping a part ofthe live view to correspond to a size of the sub display area, anddisplaying the part on the sub display area.

The displaying on the other one of the main display area and the subdisplay area at operation S1920 may further include: displaying the liveview on the main display area; and, in response to the live view beingrecognized as including a person, displaying an animation on the subdisplay area.

The displaying on one of the main display area and the sub display areaat operation S1910 may include: determining a distance to a subject,and, in response to the determined distance being shorter than apredetermined distance, displaying the live view on the sub displayarea, and, in response to the determined distance being longer than thepredetermined distance, displaying the live view on the main displayarea.

The control method may further include detecting at least one of alocation and a motion of the user terminal apparatus, and a user's grip,and the displaying on the other one of the main display area and the subdisplay area at operation S1920 may include determining whether theorientation of the user terminal apparatus is changed based on at leastone of the location and the motion of the user terminal apparatus, andthe user's grip.

The displaying on the other one of the main display area and the subdisplay area at operation S1920 may include, in response to a person'sface being greater than or equal to a predetermined size beingrecognized in the live view, or in response to the person's face beinggreater than or equal to the predetermined size being recognized andthen the person's face not being recognized, determining that theorientation of the user terminal apparatus is changed.

According to various embodiments described above, the user terminalapparatus may control the displays disposed on the front surface and therear surface of the user terminal apparatus based on variousphotographing conditions, so that the user may easily photograph.

In the above descriptions, the control method when the photographingfunction is executed has been mainly explained. However, this should notbe considered as limiting. For example, in response to the orientationof the user terminal apparatus being changed while a lock screen isbeing displayed on the main display area, the processor may execute apredetermined application. In addition, in response to the orientationof the user terminal apparatus being changed while a UI indicatingreceiving of a call is being displayed on the main display area, theprocessor may connect the call. In response to the user terminalapparatus moving further away from user's ear while the user is talkingon the phone, the processor may display contacts, and the like.

In addition, the processor may display an execution state of anapplication which is being executed in the background on the sub displayarea. For example, the processor may display an execution state of aspecific game or music application, and the like. on the sub displayarea, and thus may minimize power consumption. In addition, in responseto the orientation of the user terminal apparatus being changed while aspecific application is being executed and displayed on the main displayarea, the processor may display a UI displaying essential functions ofthe corresponding application on the sub display area.

In the above-described embodiments, only the orientation of the userterminal apparatus is changed. However, a different operation may beperformed according to a direction of the changed orientation. Forexample, a different function may be executed in response to rotation ofthe user terminal apparatus in the upward direction, downward direction,rightward direction, or leftward direction. In addition, even inresponse to the user terminal apparatus being rotated in the upwarddirection, a different function may be executed according to whether therotation is made in the clockwise direction or counter clockwisedirection.

A control method of a user terminal apparatus, which includes: a displayincluding a main display area which is disposed on a front surface ofthe user terminal apparatus, and a sub display area which extends fromone side of the main display area and is disposed on at least one areaof a rear surface of the user terminal apparatus; and a cameraconfigured to photograph an image, according to the above-describedembodiments may be implemented as a computer executable program code andstored in various non-transitory computer readable media, and may beprovided to servers or devices to be executed by processors.

For example, a non-transitory computer readable medium which stores aprogram for performing the steps of in sequence: displaying a live viewacquired through the camera on one of the main display area and the subdisplay area; and, in response to an orientation of the user terminalapparatus being changed, displaying the live view on the other one ofthe main display area and the sub display area may be provided.

The non-transitory computer readable medium refers to a medium thatstores data semi-permanently rather than storing data for a very shorttime, such as a register, a cache, a memory or and the like, and isreadable by an apparatus. Specifically, the above-described variousapplications or programs may be stored in the non-transitory computerreadable medium such as a compact disc (CD), a digital versatile disc(DVD), a hard disk, a Blu-ray disc, a USB, a memory card, a ROM, and thelike, and may be provided.

While the present disclosure has been shown and described with referenceto various embodiments thereof, it will be understood by those skilledin the art that various changes in form and details may be made thereinwithout departing from the spirit and scope of the present disclosure asdefined by the appended claims and their equivalents.

What is claimed is:
 1. An electronic device comprising: a first touchdisplay disposed on a first side of the electronic device; a secondtouch display disposed on a second side of the electronic device, thefirst side and the second side being opposite sides of the electronicdevice; a camera configured to obtain one or more images, the cameradisposed on the second side of the electronic device; and at least oneprocessor configured to at least: provide, to the first touch display, afirst screen corresponding to a live view function based on a firstimage obtained through the camera, identify whether the first imageincludes a face of a first user, and based on identifying that the faceof the first user is included in the first image, provide, to the secondtouch display, a second screen corresponding to a second image includingthe face of the first user while the first screen is provided on thefirst touch display.
 2. The electronic device of claim 1, wherein thesecond image is obtained based on capturing an area including the faceof the first user in the first image.
 3. The electronic device of claim1, wherein a size of the second image corresponds to a size of thesecond touch display.
 4. The electronic device of claim 1, wherein theat least one processor is further configured to obtained the secondimage by enlarging an image corresponding to an area including the faceof the first user in the first image.
 5. The electronic device of claim1, wherein the second image is provided to be displayed in a center ofthe second touch display.
 6. The electronic device of claim 1, whereinthe at least one processor is further configured to: based onidentifying that faces of a plurality of users is included in the firstimage, identify a second user close to the electronic device among theplurality of users, provide, to the second touch display, a third screencorresponding to a third image including the face of the second user. 7.The electronic device of claim 1, wherein the at least one processor isfurther configured to: based on identifying that faces of a plurality ofusers is included in the first image, identify a third user whomaintains gaze in a direction to the electronic device among theplurality of users, provide, to the second touch display, a fourthscreen corresponding to a fourth image including the face of the thirduser.
 8. A method of an electronic device including a first touchdisplay disposed on a first side of the electronic device, a secondtouch display disposed on a second side of the electronic device, thefirst side and the second side being opposite sides of the electronicdevice, and a camera configured to obtain one or more images, the cameradisposed on the second side of the electronic device, the methodcomprising: providing, to the first touch display, a first screencorresponding to a live view function based on a first image obtainedthrough the camera; identifying whether the first image includes a faceof a first user; and based on identifying that the face of the firstuser is included in the first image, providing, to the second touchdisplay, a second screen corresponding to a second image including theface of the first user while the first screen is provided on the firsttouch display.
 9. The method of claim 8, wherein the second image isobtained based on capturing an area including the face of the first userin the first image.
 10. The method of claim 8, wherein a size of thesecond image corresponds to a size of the second touch display.
 11. Themethod of claim 8, further comprising: obtaining the second image byenlarging an image corresponding to an area including the face of thefirst user in the first image.
 12. The method of claim 8, wherein thesecond image is provided to be displayed in a center of the second touchdisplay.
 13. The method of claim 8, further comprising: based onidentifying that faces of a plurality of users is included in the firstimage, identifying a second user close to the electronic device amongthe plurality of users; and providing, to the second touch display, athird screen corresponding to a third image including the face of thesecond user.
 14. The method of claim 8, further comprising: based onidentifying that faces of a plurality of users is included in the firstimage, identifying a third user who maintains gaze in a direction to theelectronic device among the plurality of users; and providing, to thesecond touch display, a fourth screen corresponding to a fourth imageincluding the face of the third user.